Hierarchical solutions of the Sherrington-Kirkpatrick model: Exact asymptotic 

behavior near the critical temperature 
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We analyze the replica-symmetry-breaking construction in the Sherrington-Kirkpatrick model of 
a spin glass. We present a general scheme for deriving an exact asymptotic behavior near the 
critical temperature of the solution with an arbitrary number of discrete hierarchies of the broken 
replica symmetry. We show that all solutions with finite-many hierarchies are unstable and only 
the scheme with infinite-many hierarchies becomes marginally stable. We show how the solutions 
from the discrete replica-symmetry-breaking scheme go over to the continuous one with increasing 
the number of hierarchies. 
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I. INTRODUCTION 

Spin glasses are specific unusual statistical systems, 
since except for a few limiting cases no exact ana- 
lytic solutions are available, even for mean-field mod- 
els. A formal exact solution of the mean-field Ising spin 
glass, Sherrington-Kirkpatrick (SK) model, is known in 
form of the replica-symmetry-breaking (RSB) scheme of 
Parisi. p] The solution of the RSB construction is, how- 
ever, explicitly known only approximately. One can 
iterate the RSB scheme with finite many hierarchies. 
In this way 1RSB and 2RSB solutions were explicitly 
calculated. |2f Or one can go over to the limit of infi- 
nite number of hierarchies and try to find a solution to 
the continuous limit of the RSB scheme controlled by 
a nonlinear partial differential equation. A solution to 
the continuous RSB scheme is known near the critical 
temperature. 

B H II II H Recently, a numerical solu- 
tion of the differential equation from the continuous RSB 
scheme was obtained also beyond the critical region at 
zero magnetic field. 

The RSB construction has hence presently two analyt- 
ically accessible limits: the discrete scheme with a few 
hierarchies and the continuous limit. The former, within 
1RSB or 2RSB schemes, can be applied anywhere in the 
low-temperature phase. The latter, on the other hand, 
is viable practically only near the critical temperature 
at zero magnetic field. Originally the discrete scheme 
was considered as an approximation to the ultimate so- 
lution, the continuous limit. Recently, however, variants 
of mean-field spin glass models such as random-energy 
H, p-spin @ or Potts [l^ , display regions where already 
1RSB scheme becomes stable. The discrete RSB scheme 
has thus won its own substantiation beyond a mere ap- 
proximate scheme. Moreover, using the concept of ther- 
modynamic homogeneity one can derive the discrete RSB 
scheme with finite-many hierarchies without any specific 
assumptions on the behavior of the order parameters. 
Even in the limiting case of the discrete RSB scheme 
with infinite-many hierarchies one need not end up with 
the continuous limit. To derive the continuous limit one 



has to assume that both differences Aqi = qi+\ — qi and 
Ami — mi — TOi+i from the Parisi construction are in- 
finitesimal (of order 1 /K) if the number of hierarchies K 
approaches infinity. There is no a priori reason for such 
a uniform behavior and unless proved by explicit calcula- 
tions, it must be assumed as an ansatz, as actually done 
by Parisi in his derivation of the full RSB solution. 

The number of hierarchies used in the RSB solution is 
generally a free parameter that cannot be derived from 
free energy. This number is determined from stabil- 
ity of the thermodynamic equilibrium state. To decide 
how many hierarchies in the RSB scheme are needed to 
reach a thermodynamically stable solution and whether 
the infinite number of hierarchies leads to the continuous 
distribution of the order parameters one has to analyze 
the RSB scheme with a variable number of hierarchies. 
This is possible only in specific asymptotic limits such 
as the asymptotic region near the critical temperature. 
The existing analyses [2, H H H @ of the RSB scheme 
near the critical temperature use an incomplete expan- 
sion of free energy where only a single, simplest term 
from the highest-order contribution is taken into consid- 
eration. Such an expansion does not reproduce correctly 
the asymptotic behavior of the RSB solutions with a few 
hierarchies (1RSB, 2RSB). It hence cannot serve as a 
proof of validity of the continuous limit for the RSB so- 
lution with infinite-many hierarchies. 

The aim of this paper is to present a general scheme 
for analyzing the full discrete hierarchy of RSB solutions 
for mean-field models of spin glasses. We in particu- 
lar concentrate on the SK model at zero magnetic field 
and use the asymptotic solution to determine the way 
in which the limit of infinite many hierarchical levels is 
approached. With the exact asymptotic solution for ar- 
bitrary numbers of RSB hierarchies we prove that the 
stable solution of the SK model is the continuous limit 
of the RSB scheme. We explicitly evaluate the equations 
for the order parameters in the first nontrivial order of 
the expansion parameter 9 = 1— T/T c around the crit- 
ical temperature T c . We perform the expansion gener- 
ally for the RSB solution with K hierarchies. To achieve 
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this goal, we use an explicit representation for the hi- 
erarchical free energy (partition function) with K levels 
from which we derive equations for the order parameters. 
These equations are then asymptotically expanded near 
the critical temperature to obtain an explicit leading- 
order asymptotic behavior of all the order parameters at 
any hierarchical level of the RSB construction. From it 
we reconstruct the continuous version of the RSB scheme 
when the number of hierarchies is limited to infinity. We 
explicitly show that any solution with a finite number of 
hierarchies is unstable even arbitrarily close to the critical 
temperature and only the continuous limit, as expected, 
becomes marginally stable in the spin-glass phase. Q| 



II. RSB SOLUTION WITH K HIERARCHIES 

We avoid the replica trick and use the explicit represen- 
tation of the RSB solution with generally K hierarchies 
from Ref. derived from the thermodynamic approach 
of Thouless, Anderson, and Palmer. In this representa- 
tion the solution has 2K+1 order parameters. There are 
K + 1 physical ones, q, Axi, • ■ ■ , Axk related to various 
ways squares of local magnetizations can be calculated. 
The other K parameters, mi, . . . ,mx, have a geomet- 
ric origin and are connected with the way we break the 
replica symmetry. 

To derive an analytic representation for the K-\eve\ 
hierarchical free energy we start with an averaged free- 
energy density of the Sherrington-Kirkpatrick model with 
v real replicas 
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where the trace Trg runs over the replicated Ising spins 
S a = ±1. We denoted the internal magnetic field 
h = h + T\^fq_- Averaging over the fluctuating internal 
field r\ replaces averaging over the spin exchange in 
the mean-field solution. The averaged order parameter 
at the saddle point q = ((S ,a ) 2 -) au does not depend on 
the replica index due to equivalence of replicas. Real 
replicas allow us to introduce local inter-replica suscep- 
tibilities as order parameters being at the saddle point 
X ab = ((S a S b ) T )av ~ q- Angular brackets ( ) T denote 
averaging over the configurations of replicated spins. 

The hierarchical solution is constructed by successive 
applications of the replica symmetry ansatz on the matrix 
of the overlap susceptibilities We remind that \ aa = 0. 
For K — 1 we choose x a ^ b = Xi an d decouple the 



spin variables via a Hubbard- Stratonovich transforma- 
tion and a new fluctuating replica-diagonal field Ai. This 
transformation enables us to evaluate the trace over the 
replicated spins explicitly. We recover 1RSB solution of 
Parisi. The next hierarchy is obtained if we replace each 
matrix element \ ah by a matrix X°aB • We a § am a Pply 
the replica symmetry ansatz on non-diagonal elements. 
We have two parameters X^ttd — Xi an d — X2- 

The replicated spins will be decoupled with two Hubbard- 
Stratonovich fluctuating field Ai, A2. We proceed in this 
hierarchical construction up to the desired if-level solu- 
tion. 

We can conveniently represent the if -level free energy 
recursively. We define a sequence of partition functions 
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where we used an abbreviation for the Gaussian differen- 
tial T>\] = dAf e~ A ' / 2 /\/27r. The initial condition reads 

The aver- 
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aged free energy density with K hierarchies can then be 
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with order parameters q, Axi and mi, I = 1, . . . , K to be 
determined from stationarity equations. 

To represent the mean-field equations we introduce a 
set of hierarchical density matrices in the space of fluctu- 
ating random fields A;. We define pi(r), Xk, . . . , A;) = 
^i-i/v^z-i) x- We mrther introduce short-hand 
notations t = tanh (3 + r/^/q + Y^iLi M V^Xi) 

and (t)i(ri,X K ,...,Xi + i) = (pi . . . {pit)\ t . . .)x, with 
(X(Xi)) Xl =jr oo 'DX l X(X l ). 

With the above definitions we can write down the sta- 
tionarity equations for the physical order parameters 



and for the geometric ones 
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(4b) 
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where index I — 1, . . . , K . Note that there is a direct 
connection to the order parameters of the Parisi A'-level 
RSB solution. The Parisi parameters are identified as 
follows q = q K and qi = q K + Y^,f=i ^xf ■ 
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It is important to stress that the hierarchical free- 
energy density from Eq. is not identical with discrete 
A-level RSB solutions used in the literature to analyze 
the critical region of the spin-glass transition in the SK 
model [1 [3- 0. El The latter functionals can be de- 
rived from the asymptotic limit T /* T c of Eq. IpJ) by 
using K~ x expansion to order 0(K~ 4 ) with an ansatz 
A\i = Ai/K and mi/mi+i = 1 + Si/K. This step is in 
fact a discrete version of the continuous limit studied in 
Sec. E The full discrete RSB free energy equivalent to 
Eq. (PJ was derived in Ref. 12] but not used in explicit 
calculations. A necessity of modifications to the A- level 
hierarchical free energies from Refs. [Slil ID, |(j . when A 
remains finite was discussed in Ref. |l3j. 

The hierarchical free energy, Eq. ©, and the re- 
spective stationarity equations, Eq. (0J and Eq. JHJ, 
were derived within the real-replica approach. The 
real replicas simulate dependence of the mean-field so- 
lutions on initial conditions. The RSB scheme says 
that the initial configurations of the order parame- 
ters arc ordered hierarchically according to the strength 
with which they influence the resulting equilibrium 
state. The instantaneous value of the local magnetiza- 



tion is tanh 



where the 



quenched random field 7/ stands for an actual configura- 
tion of spin couplings and the annealed random fields 
A; for initial configurations of the spin variables from 
the lih level with I = 1,2,..., A. The strength with 
which the ith level influences the final equilibrated state 
is A\i- The density matrices pi express probability 
(weight) of the ith level initial configurations in the fi- 
nal state. Hence, (t); denotes a local magnetization ob- 
tained after averaging over the first I levels of initial con- 
figurations. The physical order parameters are then con- 
structed from various possibilities to interchange making 
square and averaging over the hierarchies of the initial 
configurations of local magnetizations. 

The number of hierarchical levels A is a free parame- 
ter in the above construction. Its physical value leading 
to a unique physical solution is determined as the small- 
est number needed to reach a thermodynamically stable 
equilibrium state independent of initial conditions. Ther- 
modynamic stability of a construction with A hierarchies 
is determined from a set of K + l stability conditions. [Tl| 
If 



A i=/ 3 2 (((l-t 2 



Y^rni {{t)ti-{t?i 



i=i 




>0. (6) 



are obeyed for I = 0, 1, . . . , K, then the solution with A 
hierarchies describes a locally stable equilibrium state. If 
one or more stability conditions are broken, we have to 
increase the number of hierarchies in our construction. 
With increasing the number of hierarchies used one has 
to observe a successive suppression of instabilities (neg- 
ativeness of parameters A;) when the construction con- 



verges. Only a convergent scheme can lead to a stable 
solution for some finite or, in the extreme case, infinite 
number of hierarchies. 



III. ASYMPTOTIC EXPANSION NEAR THE 
CRITICAL TEMPERATURE 

The order parameters in the spin-glass phase of the 
general A-level free energy from Eq. © cannot be solved 
explicitly unless we resort to solutions with only a few 
hierarchical levels (A = 1,2). The only chance to ana- 
lyze the behavior of the entire hierarchical construction, 
that is with arbitrary numbers of hierarchies, is to ex- 
pand the solution near the critical point where the order 
parameters are small. The hierarchical solution behaves 
in an external magnetic field differently from the rota- 
tionally invariant case. The physical order parameter q 
and the geometric order parameters mi remain finite at 
the transition line and only the differences of the over- 
lap susceptibilities A\i are the genuine small parameters 
controlling the expansion near the critical point. While 
in the case of zero magnetic field all order parameters de- 
termining the stationarity points of free energy asymp- 
totically vanish at the critical temperature. The latter 
case is on one hand more degenerate than the former, 
but on the other hand it is more symmetric with less ex- 
pansion terms (only terms with even parity contribute 
in the rotationally invariant case). In this paper we will 
analyze only the rotationally invariant case, h = 0. 

The strategy to solve the stationarity equations for the 
hierarchical free energy asymptotically near the critical 
temperature is to expand the partition function into pow- 
ers of the small order parameters and restrict the solution 
only to a functional subspace generated by a fixed poly- 
nomial expansion. We first use sch an expansion to derive 
the leading asymptotic limit of equations for the physical 
parameters q, A\i ■ At this stage we do not need to as- 
sume smallness of the geometric parameters. Smallness 
of m;, I = 1, . . . , K at zero magnetic field will be utilized 
later on when deriving the asymptotic form of mean-field 
equations for them. 

It appears that it is sufficient to expand the station- 
arity equations for q and A\i only to the third order in 
these parameters. To control the expansion we introduce 
an auxiliary parameter x that will be set to unity at the 
end. We hence write a canonical representation for the 
Zth partition sum 

= og] + ogj (Y l+1 + qA/) 2 x 2 + o$ (Y l+1 
+c l \ l f x 4 + a$ (Y l+1 + qA/) 6 x e + x 2 [<&> 
+42 (Y l+1 + ctXif x 2 + 4'i [Y l+l + C/ A,) 4 x 4 

+ x 4 [a$ + a { H (Y l+1 +c l X l ) 2 x 2 } + x 6 a { ^ (7) 



where we denoted Yi 



4 



We now insert Eq. J7J) into Eq. Q and perform the 
integral over the fluctuating field A; . The result will again 
be reduced to a sixth order polynomial in x. Thereby 
we win recursive relations for the expansion parameters. 
We used the program MATHEMATICA to evaluate the 
coefficients. The coefficients needed in expansion JJJ) are 
listed in Appendix A. 

Using the asymptotic expansion for the partition func- 
tions Zi we can explicitly evaluate products of the density 
matrices pi. We will need to know the products within 
our precision only as quadratic polynomials in x. Wc 
explicitly obtain 



We note that Q has the meaning of the Edwards- 
Anderson parameter. It is, however, not an independent 
order parameter. 

Analogously we derive the asymptotic form of the 
defining equations for the differences of the overlap sus- 
ceptibilities. We derive the following asymptotic equa- 
tions 



A X! =^A Xi |l-2n 
+5Q 2 - (2Q - 2AV! 



P 4 
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We use Eq. (JSJ in the defining equations for the phys- 
ical order parameters. We denote Xi — Yl\=i ^Xh 
Q = q + Xfc, and Mi — Y2i=i m iAxi and obtain (x = I) 



q = (3 2 q l-2/3 2 Q + /? 4 



V + 5Q 2 + 2M K 



(9a) 



We skip the upper index K at the order parameters in 
order not to make the notation cumbersome The above 
equation can further be rewritten to a more suitable form 

q = I3 2 q jl - 2/3 2 Q + ^ [2X 2 K - AQX K 

+17Q 2 + 6M K ]} . (9b) 



Notice that to determine the leading asymptotic behav- 
ior of q and A\i we had to keep first three orders in 
the expansion of the right-hand sides of the stationarity 
equations I0J. Second-order term is degenerate in these 
equations and we obtain from it only the leading asymp- 
totic behavior of the Edwards- Anderson parameter Q. 
Going to the third order then means that we have to 
calculate simultaneously to the leading asymptotic be- 
havior of q and A\i also the next-to-leading asymptotic 
coefficient of the Edwards- Anderson parameter. 

To derive the asymptotic form of equations (|5J) for the 
geometric parameters mi is more complicated than it was 
to obtain equations and (|lf}|> . For the geometric pa- 
rameters we will need all the coefficients a$ from Ap- 
pendix A, but those at the highest power x 6 only for 
mi = 0, since mi ~ x 2 . In fact, we have to expand free 
energy to the order x 8 , but the highest-order terms can- 
cel each other due to subtraction in the numerator on the 
right-hand side of Eq JSJ) . After some effort we arrive at 



{ff - I) [A X ; + 2Qi +1 ] mi = ^-m, { [6A X 2 + 18A X ;Q;+i + 12Q 2 +1 + 6(A X / + 2Q ;+1 )AVi - 6(A X ; + 2Q i+1 )Mj_i 



K 



-4(Axi+3Q i+ i)m i Axi-6 ^ m l A Xl (2Q %+1 + A Xt ) 

i=l+l 



1 [34Q? +a + 81Q 2 +1 A Xi + 64Q i+1 A x 2 + 16A X ? 



-10(3A X 2 + 9Qi +1 A X i + 6Q 2 +1 )AVi + 3(A Xi + 2Q i+1 ) 



l-l 



2* 2 _ 1 +3^A X2 (2AV 1 +A Xl 



, (11) 



r 



where we denoted Qi+i = Q — Xi. Also here we had 
to keep first three orders in the expansion of the right- 
hand side of Eq. Ipfl. In the above asymptotic form we 
already used the fact that also the geometric parameters 
at h = are small near the critical temperature and are 
of the same order as q and A X / . 

Equations (|9^1- (|II|I define the asymptotic behavior of 
the hierarchical solution near the critical temperature at 
zero magnetic field. From these equations we are able to 
determine the leading asymptotic behavior of all the or- 
der parameters for an arbitrary number of hierarchies K 



together with the next-to-leading order of the Edwards- 
Anderson parameter Q. All equations are homogeneous 
in the respective variable, hence a trivial solution (para- 
magnetic phase) is correctly included. The asymptotic 
equations are cubic in the physical order parameters and 
quadratic in the geometric ones. Such a system of cou- 
pled algebraic equations is not generally solvable. We, 
however, show that a nontrivial solution in the physical 
sector can always be found. 
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IV. NONTRIVIAL SOLUTION OF THE 
ASYMPTOTIC EQUATIONS 

We now expand the dynamical variables in a small pa- 
rameter measuring the distance from the critical point 
in the spin-glass phase 9 = 1 — T/T c . We have to keep 
only the leading asymptotic order and for the Edwards- 
Anderson parameter we have to add the next-to-leading 
order. Not to introduce cumbersome further indexing 
or new parameters we relabel in this chapter the order 
parameters as follow q — > qQ, A\i — > Xi@> m i ~ * w/^j 
Q — > Q9 + Q'9' 2 . We expand the asymptotic equations in 
powers of 9 and all expansion coefficients (up to 9 3 ) from 
the left-hand side must equal those from the right-hand 
side. 

Excluding the trivial solution from Eqs. J^J-JITJ the 
first term on the right-hand side defines the critical tem- 
perature. From the second one in Eqs. JJJJ and 1(10(1 we 
obtain 

= 1. (12) 

Notice that the Edwards- Anderson parameter in the 
leading order is defined exactly by the replica-symmetric 
solution (K = 0). 

The first nontrivial terms contributing to the order pa- 
rameters of the hierarchical solution are the third ones. 
The corresponding coefficients at 9 3 of Eqs. and 110(1 
are 

= 1 - 3Q' + X% - 2X K + 3M K , (13) 

= -6Q' + 2 x f + 6(1 - *-i)(l - AVi - Xi) 

+ m,Xi+6Mi_i . (14) 

We use the former equation to exclude the next-to- 
lcading coefficient Q' of the Edwards- Anderson parame- 



ter, that is 

Q' = ~ [1 - X K (2 - X K ) + 3M K ] . (15) 
Using this result in Eq. (|14fl we obtain a recursive relation 

mai = \ [2 + X K {2 - X K ) + X 2 i- 3*1 (1 - *-i) 

K 

-3X^(2 - *,_!)] - 2 J2 m ^ ■ (16) 

i=l + l 

An explicit solution to this set of recursive equations 
reads 

2 K ~ l 

mat = 7^( 2 - MC" 1 )' [2 + X K (2 - X K ) + X f +i 
6 i=o 

-3 Xi+J (l-X i+l _ 1 )-3X i+4 _ 1 (2-X i+ . i _ 1 )] . (17) 

We have now to exclude the geometric parameters mi 
from Eq. 1(16(1 . To this purpose we use Eq. 1(17(1 in the 
asymptotic expansion of Eq. ((11(1 . We then obtain an- 
other set of recursive equations 

mi X f = \( 2 - 2*J-i - Xl) [2X K (2 - X K ) 

-Xi(2 - 2A^i - Xl) - *-i(4 + 7X ; _i) 

l-l 1 K 

+9^Xi(2*i-i+Xi) -3 Y, miXiiHXi-Xi) 

z=l J i=l+l 

-(Xi-Xi)} • (18) 

Combing Eq. 1(17(1 and Eq. ((18(1 we end up with a set of 
equations with only the leading-order asymptotic coeffi- 
cients at the differences of the overlap susceptibilities xi '■ 



K-l 



;X i £(2- M(-l) 1 [2 + X K (2 - X K ) + X 2 i +l ~ 3 X / +l (l - Xi+i-i) - 3X J+i _i(2 - X I+i -i)] 



i=0 



(2-2Jf,_i-xO 



2X^(2 - A-jr) - Xi(2 - 2X,_i - XJ ) - *i-i(4 + 7X,_i) + 9^Xi(2*-i + Xi) 



i=l 



if if-i 

4 Y [2(* - *i) - (Xt - Xl)] E ( 2 ~ 5 i.o)(-l) j [2 + *k(2 - **) + Xf+i ~ 3 ^+«(l - 

-3X,-+i_i(2-A- i+< _i)] . (19) 



r 



The set of equations for X i> ' = 1,2, ... ,K looks rather 
complicated but we can successively express the suscep- 
tibilities xi via their sums Xi—\. 



Putting I = K in Eq. ((19(1 we obtain a simple cubic 
equation for xk- 

= X k(2 - 2X K _ 1 - xk)(2 - 2X K -i - 3 X k) ■ (20) 
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One solution is trivial, \k — 0, one is unphysical, \k = 
2(1 — Xk-i)- The only physically acceptable solution in 
the spin-glass phase is xk = 2(1 — A"#_i)/3. 

Next we use this physical solution in Eq. (|19|l for I = 
K — 1. We again can factorize this equation for XK-i to 
a product 

= xk-i(2 - 2X K _ 2 - Xk-i){2 - 2A A -_ 2 - 5xjt-i) • 

(21) 

The only physical solution is xk-i = 2(1 — Xk-2}/5. 

We go on with this successive substitutions and derive 
a generic physical solution 



Xk-i 



2/ + 3 



(22) 



Realizing that Xq = wc obtain an explicit solution for 
all coefficients xi, I — 1,2, ... ,K. 



V. PROPERTIES OF THE ASYMPTOTIC 
SOLUTION AND THE CONTINUOUS LIMIT 

After finding an explicit expression for the leading 
asymptotic terms of the local overlap susceptibilities we 
can recover the leading-order (in some case also the next- 
to-leading-order asymptotic) coefficients for all physi- 
cal quantities of interest. We now use solution (|22ll in 
Eqs. (|17fl . (|15fl and (|12|) to obtain an explicit asymptotic 
form of the order parameters: 



2K + 1 



4(K-l + l) 



2K 
1 



1 



2K+ 1 



(23a) 
(23b) 
(23c) 



and the first two leading orders of the Edwards- Anderson 
parameter 



K 12K(K+1) + 1 

3(2K + 1) 2 



(23d) 



We returned to the superscript explicitly denoting the 
dependence of the order parameters on the number of 
hierarchies. 

First thing we can observe is that both differences Axf 
and Amf = to/_i — mi, mo = 1, do not depend on the 
hierarchy index I. We have Amf = 2Axf = 4/(2K+l). 
It means that if all solutions with finite hierarchical levels 
are unstable we have to choose the number of hierarchies 
infinite. The discrete RSB scheme then converges to a 
continuous theory with either Ax K or Am K as infinites- 
imal differentials. The ratio of the two differentials is in 
the leading order near the critical temperature constant, 
Ax K /Am K = 1/2. This ratio is even independent of the 
total number of hierarchies K . 

Before we investigate stability of the solution with K 
hierarchies we evaluate other physical quantities of in- 
terest with the aid of the asymptotic form of the order 



parameters to see how they depend on the number of 
hierarchies. With Eqs. (|23|) we are able to evaluate the 
leading deviation beyond the paramagnetic solution. We 
start with the thermal local susceptibility xt that in the 
spin-glass phase does not obey the single-state Fischer 
relation, xt = /?(! — <3)-d4] In the RSB solution we have 



A" 



XT 



1=1 



3(2jr + i) 



(24) 



We see that in the limit K — > oo the local susceptibility 
seems to be a constant below the critical temperature. 

Another physical quantity of interest is the density of 
internal energy that behaves near the critical tempera- 
ture in the following manner 



K 







(i-Q 2 



i=i 



|£m l A Xl (2Q,-A;o) = -i-| + ^ . (25 ) 



The first two terms in the temperature behavior of the in- 
ternal energy are from the paramagnetic solution (trivial 
order parameters). The third term is fully determined by 
the SK solution, since it does not depend on the number 
of hierarchical levels used. 

The last quantity the asymptotic behavior of which 
we evaluate near the critical temperature is free en- 
ergy. We do not need to expand the free energy di- 
rectly, since we can use the asymptotic expansion for 
the internal energy and the defining equation relating 
the two quantities from Eq. i|25[) . It can be rewritten 
to a more suitable form using the expansion parameter 
9: u = f + (1 — 9)df /d9. Using this equation and the 
asymptotic result from Eq. l|25[) we easily find 

a q2 n3 nA 

f = -ln2- -(21n2 + l) + — . (26) 

J 2 V ' 4 12 24 V ' 

We can see that the leading order asymptotic terms in 
the order parameters breaking the replica symmetry con- 
tribute to the density of free energy only in the fifth or- 
der of the deviation from the critical temperature. This 
order cannot, however, be determined exactly from the 
leading asymptotic form of the stationarity equations for 
the order parameters. 

We can, nevertheless, improve upon the precision of the 
asymptotic expansion of free energy and consequently of 
internal energy without increasing the precision of the 
order parameters. We can apply the asymptotic expan- 
sion in 9 directly to the functional of free energy. We 
then are able to expand free energy at the saddle point 
to the order 0(9 5 ) and internal energy to 0(9 4 ). It ap- 
pears that the next-to-leading asymptotic contributions 
to the order parameters cancel each other in free energy 
up to the order 0(9 5 ). Using the asymptotic form of the 
interacting part of free energy from Eq. (|B1|I in Eq. @ 
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together with the asymptotic solutions for the order pa- 
rameters we end up with corrections to the paramagnetic 
solution of free energy 

Af = ( -e 3 + —e 4 + —e 5 ) - —e 5 (— V (27) 

J \6 24 120 / 360 \K y ' 



and of internal energy 



Au 



72 



(28) 



The number of hierarchies K is a free parameter in 
the general hierarchical solution we analyzed. To make 
the solution unique we have to decide what choice of this 
parameter leads to the exact solution. Generally, the 
number of hierarchies in free energy is the minimal 
one for which all stability conditions from Eq. JfjJ are 
satisfied. We have K + 1 stability conditions for a given 
K. In the first two leading asymptotic orders they can 
be rewritten with the aid of the order parameters as 

A ; = 1 

- P 2 [1 - 2Q + 2Mi + X? + 2Q l+1 Xi + 3Qf +1 ] . (29) 

Using the relation between quantities Qi+i and Xi and 
the expansion of the order parameters to the leading or- 
der and the Edwards-Anderson parameter to the next- 
to-leading order we obtain 



A ; = -29(1 - Q) 



-26 A 



(1-Xi) 2 --(1-X K ) 2 +M l -M, 



K 



(30) 



It is clear from the solution from Eq. (12,'j[| that the linear 
term on the right-hand side of Eq. I|30|) vanishes. The first 
nontrivial temperature-dependent term then reads 15j 



A, = -- 



3 (2K+1) 



(31) 



All the stability conditions collapse in the leading asymp- 
totic order to a single expression independent of the hi- 
erarchical index I. Since the stability parameters Aj are 
negative at any K, we conclude that no finite number of 
hierarchies in Eq. © is able to produce a physical so- 
lution with no negative values for the stability param- 
eters. Since lirnK"_ >0O A; = 0, only the solution with 
infinite-many hierarchical levels is physically acceptable. 
The RSB solution with infinite many hierarchies is then 
marginally stable. 

We can see from the asymptotic solution <|23l) that the 
limit of infinite-many hierarchies leads to a continuous 
limit with infinitesimal differentials A\i or Am;. The 
continuous limit then results in simplifications of the hi- 
erarchical free energy and the corresponding equations 
of motion. First, all higher than linear powers of the 
difference A\i (for the fixed index I) vanish from the 



continuous limit. With this simplification in mind we 
can significantly reduce the set of equations 119|) for the 
leading-order coefficients of the overlap susceptibilities 
We assign continuous quantities to the following discrete 
variables: Xi — > x, m; — > m(x), Xk — * x max . Equa- 
tion Q19|l then reduces to 

3 / dy(y - x)m(y) 

— (1 x}\x raax (2 x raax ) x(2 x)j . (32) 

We know that x max = 1 — <?• We can now solve Eq. i|32|) 
independently of the discrete approximations. We denote 
M (x) = f x dym(y) and M = M(l) and rewrite Eq. 
to 



3(M - M(x)) = x max (2 - x max ) - x(2 - x) 

+ 2(1 -x) 



(33) 



From continuity of the function M{x) we obtain x max 
1 and hence q = 0. A derivative of this equation with 
respect to x leads to an explicit representation 



m(x) = 2(1 — x) 



(34) 



Finally, using the continuous version of Eq. i|15|) we de- 
rive the next-to-leading asymptotic term of the Edwards- 
Anderson order parameter Q' = dxm(x) = M = 1. 

The solution obtained from the continuous version of 
the RSB scheme coincides with the limit of the discrete 
scheme with infinite number of hierarchies. All the physi- 
cal quantities, when infinite- many hierarchies arc needed 
to reach a stable solution, can hence be derived directly 
from the continuous RSB scheme. The only information 
we lose in the continuous solution is the rate with which 
the continuous limit is approached. 



VI. CONCLUSIONS 

We studied in this paper the full discrete hierarchy of 
RSB solutions of the zero-field SK model in the critical 
region below the transition temperature to the spin-glass 
phase. We expanded the stationarity equations for all the 
order parameters to an appropriate order in 9 = 1 — T/T c 
so as to find their leading asymptotic behavior. We suc- 
ceeded in solving the resulting equations and obtained 
an explicit leading asymptotic behavior of all thermody- 
namic functions of the RSB solution with an arbitrary 
number of hierarchies. The number of hierarchies in the 
RSB solution is treated as a free parameter to be de- 
termined from stability conditions. Stability of the RSB 
scheme with K hierarchies is measured by K + 1 num- 
bers A;, I = 0,1,..., if from Eq. iJBJ. All these num- 
bers must be nonnegative in a (marginally) stable so- 
lution. We explicitly evaluated these numbers with the 
asymptotic solution for the order parameters and found 
that any solution with finite-many hierarchies is unstable 
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with instability of order 2 . Near the critical tempera- 
ture all the stability conditions collapse in the first two 
leading asymptotic orders to a single criterion. With the 
increasing number of hierarchies the instability parame- 
ters decrease and become zero at K = oo . Hence first the 
infinite-order RSB is marginally stable below the critical 
temperature. 

The most important physical issue we addressed in 
this paper was the legitimacy of the continuous limit. 
We proved by explicit calculation that the discrete RSB 
scheme indeed converges toward the continuous limit 
with K — ► oo. We found that near the critical tempera- 
ture both the overlap susceptibilities Xl an d the geomet- 
ric parameters mi determining the way the replica sym- 
metry is broken are uniformly distributed and their differ- 
ences Axi and Am; become infinitesimal for K — > oo. Ei- 
ther of these differences can hence be used as a fundamen- 
tal differential for the continuous limit. Since the differ- 
ences with the same hierarchy index I appear in the free 
energy of the continuous limit only linearly, we loose one 
set of stationarity equations from the discrete version. 
It appeared more natural to choose dx = lim^-^oo Axk 
as the underlying differential for the continuous formula- 
tion of the RSB solution with infinite-many hierarchies. 
Hence, Axi are no longer variational parameters in the 
continuous limit and only x ma x, the maximal value for 
the overlap susceptibility is to be determined from the 
free energy functional for the continuous limit of the RSB 
scheme. 

The asset of the present construction, however, is not 
only in that it provides a proof of exactness of the con- 
tinuous limit for the zero-field SK model near the critical 
temperature. This conclusion was actually believed to 
be correct already from the existing less accurate treat- 
ments. With our construction we set up a general scheme 
how to solve the RSB equations with an arbitrary num- 
ber of hierarchies near the critical point practically for 
any mean-field spin-glass model. We applied this con- 
struction to the case of zero magnetic field in the SK 
model. But the same scheme can be applied also in the 
presence of a magnetic field and expand the hierarchi- 
cal solution around the de Almeida-Thouless line. In 
this case, however, the geometric order parameters are 



no longer small. We can as well apply the expansion 
scheme to other mean-field spin-glass models. Of partic- 
ular interest are those where one expects that in certain 
parameter regions the RSB solutions with a few hierar- 
chies (1RSB) are stable, such as the Potts spin glass. The 
question that has not yet been answered is whether the 
instability of the 1RSB solution there leads already to 
the continuous limit or not. The scheme presented here 
can conveniently be used to address this problem. 
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APPENDIX A: EXPANSION COEFFICIENTS 
FOR PARTITION SUM NEAR THE CRITICAL 
TEMPERATURE 

Here we list the expansion coefficients needed for the 
asymptotic solution near the critical temperature. We 
evaluate the coefficients used for the Zth partition sum in 
Eq. 0. We used MATHEMATICA to derive the recur- 
sive relations from which we then obtained 



(0 _ 

a 0i — a 0i 



I 



(0 \ " 2 

«20 = «02 2^ C * 

i=l 



,(') 



= 6a 04 E c i + 2a 02 E( m * - 1 ) c 



i=l i=l 
I 



= 15a 06 E c ? + 2a 02(4a 04 - a^) E( m * - 1 ) c 



(Al) 
(A2) 

(A3) 

)c? 
(A4) 



aS = 3a 4 > ' c 



i=l 









+ a 02 E c ? 


*' =1 


i=l 



3=1 



rrij — l)c 2 + (rrii — l)c 2 



(A5) 



all = 45a 06 E °i 



i-l 



2 E 



2 i 2 



3 = 1 



12a 2a 4 E ' 



(4m 4 - ll)c? + 2 E( 4m 3 _ 5 ) ( 
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3 = 1 


i-l 




12 Ek- 




3 = 1 





(A6) 
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i=i 



i-l 



3=1 



3=1 



K - 1) ( c) + ) + 4^(m fc - l)c 2 fe 

fe=i 



i-i 

E< 

fe=i 



+ 4>E C * J l( mi -l) c 2 



(4m, - 11)4 + 3 ^( 4m J ~ 5 ) c i 



i=i 



3 = 1 



i-i i-i i-i 

12 E c ? E( m * - !)4 +Ek - l ) c 
3=1 fe=i j=i 



(4m J -ll) S 2 + 2^(4m fc -5)4 



fe=i 



(A7) 



The initial coefficients arc determined by the hyperbolic 
cosine in Zq and read aoo = 1, &02 = 1/2, 004 = 1/24, 
and a 06 = 1/720. 

APPENDIX B: DIRECT ASYMPTOTIC 
EXPANSION OF FREE ENERGY 

Instead of expanding the stationarity equations we can 
expand directly free energy near the critical point. The 
advantage of such an expansion is a possibility to go to 
higher orders of the small expansion parameter more eas- 
ier than in the case of stationarity equations. The draw- 
back of a direct expansion of free energy is that when 
building up the corresponding stationarity equations we 
have to vary w.r.t. small parameters and we change the 
order of the expansion to which we keep all terms exact. 



It then may happen that different stationarity equations 
are evaluated not in the same order of the expansion pa- 
rameter. 

The expansion of free energy is achieved in the same 
manner in which we treated the partition sum with the 
expansion coefficients from Appendix A. Using the pro- 
gram MATHEMATICA we were able to go to the fifth 
order in 9. In this expansion we, however took into con- 
sideration the fact that the geometric parameters to/ oc 9 
and neglected all combinations of the order parameters 
of order 0(9 6 ). It appears that the next-to- leading or- 
der contributions to the order parameters actually con- 
tribute to free energy nontrivially first in the order 9 6 . It 
is not manifestly evident but an explicit expansion dis- 
closes this feature. If we denote Qk = f°° T>t\\wZk 

<j — CO ' 

we obtain an exact asymptotic for arbitrary number of 
hierarchical levels 
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62g 3 /3 6 17g 2 /3 4 , 27 _ 2 „ 4 , 1 2q2 , o2 3 fl2 , m ; 1\ A 2 . 



4 , T ^mz/3 4 + -gmf ^ + g/? 2 - -gm ; /3 2 + -f - - ) A x f/3 
+ , 1/62^ _ ^ + 2g2/?4 _ ^ + 1 W _ ^ + ^ m; + 1 ) Ax; , 2 



2 V 3 3 / 2 V 3 2 ' / 2 

if K 



+ E E {f ( A ^ A ^ 3 + A ^ A ^ 2 ) + 1 ( A » A *' + A *< A ^) + (^ir- + ^ - y) A x,Axf/3 : 

A™ „2 5 m ? 27m/ 17\ . 2 A 2^s { 124q/3 2 5m 7 - 17m ( 17\ . , . ^ s 
+ (^62g/3 2 + + - —j A X 2 A X 2 /? 8 + + + A X f A X */3 8 

+ ( 6 2g 2 /3 4 + \ qm ^ + 2 l qmi f + ^ - ^ + l) A Xj A x 2 /3 6 



„„ <, „ A 17g/3 2 15 ^ 9 17 ^, m 7 - m,m; . , ., , 

62g 2 /3 4 p + — gm,/3 2 + — gm,/3 2 - + - m, + 1 ) A X 2 A Xi /3 b 



/ 124<f/3 6 _ 17g 2 /3 4 
f V 3 2 + 



5g 2 m,/3 4 + y(? 2 m ; /3 4 + 2g/? 2 - gm,/? 2 - 2gm,/? 2 + gm^-m,/? 2 + ^ - A X , A X; /3 4 J 
+ EE E {62(A Xj A x 2 A x 2 + A x 2 A Xi A x 2 + A x 2 A x 2 A Xj ) / 3 10 

1=1 j=l+l i=j+l 

+^ (A Xj A Xl A x * + A* Ax? A* + A x 3 A Xi A Xl ) fi™ + (l24 Q/ 3 2 + ^ + ^ - ^) A Xl A Xj ;A x f(3 s 

^ 15too 17m; 17\ . . 9a ^9 5mi „ 17m; 17" 

=90 + + - y ) A Xi A X 2 A Xi /3 8 + f 124g/3 2 + + 5m, + - — 

+ (l24g 2 /3 4 - 17g/3 2 + hqmifi 2 + lOqmrf 2 + 17gm ; /3 2 - m, + mjmi - 2m ; + 2) A Xi A Xj A X; /3 6 } 

K K K K 

+ E E E E {l24(A Xj A Xfe A X/ A x 2 + A Xj A Xfe A x 2 A Xl + A Xj A x 2 A X; A X4 + A x 2 A Xfe A X/ A Xl )/3 10 

1=1 j=l+l i=j + l k=i+l 

+ (248g/? 2 + 5m, + lOmj + 17m ; - 17) A x ,A Xj A Xfe A X/ /3 8 } 

K K K K K 

+ E E E E E 248/3 10 A Xj A Xj A Xfe A Xi A Xp . (Bl) 

1=1 j=l+l i=j + l k=i+l p=k+l 



I 

Although the interacting part of free energy Qk is of one parameters. To calculate the second asymptotic coef- 

order higher than the partition sum we used in the sta- ficients of the order parameters, in particular the geo- 

tionarity equations, we are unable to evaluate the next- metric ones, one had to know the complete form of free 

to- leading order of the asymptotic solutions for the order energy to order 0(9 6 ). 
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Note that a similar result on instability of _ftTRSB solu- 
tion near the critical model was derived within a trun- 
cated model in C. De Dominicis and P. Di Francesco, 
arXiv:cond-mat / '0301066. This calculation was done with 
only the simplest replica-symmetry-breaking term (~ 
J2ijki AxiAXj^XkA-Xi an d linear in m;,Axi for fixed I ) 



in the free energy introduced in Ref. Q. The asymptotic 
behavior of this truncated model near the critical tem- 
perature is qualitatively correct but the numerical value 
of the instability (negative value of the spin-glass suscep- 
tibility) differs from the exact one in Eq. ffiip . 



